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The third party evaluation report focuses on the 
second year activities of a three-year exemplary project in career 
education conducted by the North Central Technical Institute (NCTI) . 
The project was desigj^ed to provide career education activities to 
the adult population^f an economically depressed rural area in 
north-central Wisconsin. Job upgrading and retraining, career 
information dissemination, and inservice education were carried ouj: 
through workshops, counseling, classes, group sessions, displays, 
tours, and informational meetings. Initially, the report deals w>th 
such aceas as communication, adults 16 and over, women, agency 
cooperation, HCTI staff, school participation, and personnel. The 
second part of the report is concerned with the results of the 
efforts of the staff in selected elementary and secondary schools in 
the HCTI dif^trict. Overall, the school systems accepted the project 
consultants and the concept of career education, ' although with 
varying degrees of effectiveness. This acceptance was regarded as an 
indication of the need for such services. It was found that the 
efforts of the project staff were often frustrated by the personal . 
characteristics of the target population, as the staff was prevented 
froi dealing with them in groups such as classes or other captive 
situations* (HJ) 
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PREFACE 

This report represents a third party evaluation^ of the exemplary 
project, "Career Education for Persons in Rural Areas, Primary Focus on 
Adults 16 and Over" funded by the United States Office of Education under 
"The Vocational Education Amendments of .1968." This assessment focuses on 
the activities of the, second year of an anticipated 3 year project. Eval- 
uation services were provided under a contract with the Center for Studies 
in Vocational and Technical Education, University of Wisconsin, lladison. 

There are -two aspects of the evaluation. First, the report deals with 
such areas as Communication, Adults 16 Years and Over, Women, Agencies, North 
Central Staff, School Participation, and Personnel. The second part of the 
report deals with the results pf the efforts of the staff in selected schools, 
elementary and secondary, located in the North Central Technical Institute 
District (NCTI), VJausau. For this purpose, the procedure for evaluation .was 
used as outlined in the Draft Guidelines for the Evaluating of Career Educa- 
tion Programs submitted to the U.S. Office of Education by T)evelopment 
Associates Incorporated, Washington^ D*C^ 

The scope of the .^aluation was Outlined by Dr. Russell Paulson,- Project 
Director, "Guideline^ for ^Evaluation of Career Education," the contract with 
the Center for Studies in Vocational and Technical Education, University of 
Wisconsin, Madison. 

The evaluation was carried on by: 

Merle E. Strong, Director, Center for Studies- in Vocational 
and Technical Education and Professor, Department of Educational 
Administration, University of Wisconsin, Madison, Evaluation 
Chairman; 
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Henry C. Ahrnsbrak, Professor Emeritus, Department of Educational 
Adninistration, Project Consultant, Center for Studies in Voca- 
tional and Technical Education. 

This is the second and official edition of the third party evaluation 
of Career Education for Persons in Rural Areas - Primary Focus on Adults 
16 and Over, Exemplary Project in Vocational Education conducted by Korth 
Central Technical Institute under Part D of Public Law 90-576. The first 
edition was issued minus the treatment and control group test results to 
enabl'2 the director of the project to make his interim report. The test 
results were not to changei^ in the opinion of the evaluators, tl)e recommen- 
dations\for the continuctJ.on of the project and, therefore, an incomplete 
report waV^fWsidered peruissable and the first edition was issued. 
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INTRODUCTi-ON 

This chapter sets forth a demographic setting for the North Central Tech- 
nical Institute (NCTI) operations and hence this project; the objectives of the 
NCTI whereby to meet the needs of the people of <he District; and the objectives 
of the Exemplary Project in Vocational Education-Career Education for Persons in ^ 
Rural Areas-Primary Focus on Adults 16 and Over* 

DemographiQ Setting* 

The North Central Vocational, Technical ^ Adult Education District is one 
of 16 post-secondary education districts in Wisconsin charged by the legisla- 
ture with providing vocfflional, technical and adult education opportunities to 
the inhabitants it serves* The District consists of Price and Menominee counties 
and portions of Marathon, leaglade, Lincoln, Clark, Taylor, Shax^ano, Portage a^^d 
Waupaca countias. 
Population • 

The total population .of the North Central Institute District in* 1970 was 
327,142. Minorities nuinbered 3,743 or 1.2 percent. The largest minox'ity groip 
is American 'Indians. 

Over 58 percent of the total population lives in rural areas, 54,211 on farms 
and another 136,310 in rural non-farm areas. This is almost twice the state arer- 
age of rural ijopulaticn. , 

Men make up 99.6 percent of the population and women 50.4 percent. About 
three-fourths of the men 16 years of age and over are working or fre locking for 



* Third Party Evaluation l^eport of Career Education For Persons In Rural Arca^?- 
Primary Focus on Adults 16 and Over, Center For Studies in Vocational, .Technical 
and Adult Education, May, 1974, Madison, Wis. 
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work. Of women 16 years of age and over only about 39 percent ^ro in the labor 
force but studies show an increasing proportion of women have been entering | 
th^ labor force in recent years. 
Poverty 

In 1969, 7,923 families or 9,1 percent of all families in the District had 
incoMej less than the poverty level of $3,800 for a non-farm family of four. 
The total number of persons who wprp r^^or, incliulins family heads, spousBS, 
r-iHl.iroo^ Ami oMioj. pooplp not living with relatives was 33,614 or J 2.1 peicojit 
pf all persons. If you allowed the poverty level to be one quarter higher 
(i.e. $4,750) income for a family of four, then over 12,000 families and 47,000 
persons would fall into the poverty class. 
Employment 

In 1971, employment in the District averaged 123,300 - about the same as 
1970. Over 80 percent of the employed have non-farm wages and salary jobs, 12 per- 
cent are employdd on fams, and the balance ana made up of non-farm self- 
employed persons, unpaid family workers and household servants. , < 

An estimted average of 8,290 persons or^.3 percent of the work force 
' 'were unenployed in 1971. 
Reservation Indians 

An estimated 2,173 Indians are' living within or adjacent to reservations 
in the IJorth Central District. Of persons 16 years and over in the labor force, ^ 
409 are employed, 369^re considered unemployed, and 107 of the unemployed are 
actively seeking work. A total of 329 persons 16, years and over are not in 
" the labor force because they are students, are physically or mentally disabled, 

are retired or institutionalized, housewiv§s or are women for whom no child 

\ 

m ^ 

care substitutes are available. 
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Welfare Recipients j ... 

A total of 1,765 families were on the Aid to Families "wTfh Dependent Chil- 
dren (AFDC) regular program, and 82 families on the Unemployed Parent Com- 
ponent were reported f^r the District as of July 1972. In addition, 395 chil^ 
dren in foster homes, and licensed child care institutions were covered by AFDC 
General Relief cas^^ totaled 315. 
Schoql Enrollment , 

la 1970,, 300,024 persons 3 to 34 years old were enrolled in District 

schools. Elementary school enrollment was 57,605; high school 26,890, and 

/ 

9^,255 persons were enrolled in collage. 

Objectives of the North Central Area Bibard of Vocational, Technical, 

And Adult Education ' 

To neet the educational challenge of its district population the North 
« 

Central District Board adopted the follQwing set of objectives ^s sat forth in 
the Institutional Profile $ Area Board of the North Central Vocational,- Tech- 
nical and Adult Education District, December 1, 1972. 

1. To prepare i>ersons for employment in a wide variety of mid-raanago- 
ment, technical, skilled and semi-skilled positions. 

2. To upgrade the capabilities of persons employed, to enable them to 
maintain employment by keeping abreast of technological advance and/or 
to advance in their fi^'-ld of employment. 

3. To develop in employed persons new capabilities to meet^thelr desires 
or to cope with the necessity for job change. 

4» To assist persons in self -evaluation and determination of career di- 
rection through testing, counseling and guidance so that they may, 
through Ciducation, realize their maximum emplG3mient potential. 

5, To provide an opportunity to remove deficiencies according to indi- 




vidual needs of people who lack adequate proficiency in background 
courses necessary for success in^the vocational or technical curricu- 
lum they need to pursue. * / \ 
To encourage and provide opportunity for persons presently employed to 
become Involved in education relied to employment, to also develop 
as an individual to meet responsibilities as a member of a family and 
citizen In a free society* 

To provide ai'ea lea3ership, education programs, education services and 
facilities., consistent with the institution's objectives, desired by 
the persons in the North Central Vocational, Technical and Adult Edu- 
cation District. 



Objectives for Career Educatioti for Person^ Xn Rural 
Areas-Primary Focus On Adults 16 and Over* 

To increase career education activities to 

those persons 16 years old and older for those persons — 

a. presently in high school, public and private, 

b. presently unemployed, and 

c. presently employed. 

To enable-.them to obtain employment, 
advance iijLtbeir present enplo3rment or 
to transfek to more appropriate altema- - 
tives, by helping them become aWare of 
their abilities, provide career awareness 
experiences, career exploration activities 
and career preparation programs. 

To develop career awareness materials. 
Emphasis to be placed on "mini-course" 
development concept, and transportability 
feature for dissemination , particularly 
as they relate to broadcast educational 
television. 

TO expand career awareness programs at 
K-6 grade level. 

To expand career ax^areiisss^ of the world 



*Third Party Evaluation Report of Career Education For Persons in Rural Areas 
Primary Focus on Adults 16 and Over, Center for Studies in Vocational, 
Technical and Adult Education, May, 1974, Madison, Wis. 
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of work to ;|untor high or mij^le school* 

5. To expand caroer edi^catrion activities to 
small rural high schools v;he.re a high 
percentage of the citudent body are from 
disadvantaged, lew inco^ne families ♦** ** . 

6. To provide career awareness programs for 
the parents of high school scnixjrs who in 

the fall seracstcr are undecided as to , * 

iuiinediate career objectives (approxi- 
mately 15%)'. .V . Ife 

7. To provide sunxier career exploration 
activities to those youth presently 16, 
years old or over, v^ho are in high school* 

, and/or vzork experience programs. 

8. T',> provide counseling services and career 
infonrtation for the mature women who wish 
to re-enter the labor market. 

9. To expand cat^^cr a-.^r.renors , career explora^ 
tlon and career p'repa* coition activities to 

r 

Victnara veterans. 

10. To expand the articulation of curriculum 
develQpin3r4t in career preparation as 
depicted in the career education model 

- (see. Xppendi x) between high school vojca- 
tional programs and •*p6st-secondary voca- , 
tional-technical, education programs in a£ 
least fouf programs the first year. 

11. To expcind caroer awareness , and career counseling 
services to, those persons 16 years old and over: 
a:; in high school 

b. In po^t*secoridary vocational- preparatqry 

c. at least lOr^ of those oersons t^resently ; 
unemployed* who are registered with the ^ ' 
Wausau office of the Wisconsin State 
Emplo3nnent Service. ' ^ » 

d^ at least 2000 adults pres e ntly - > , 

eTjployed * \ , 

e. woTflen who desire^^to prepr^ro to re- 
enter the labor market. ^ 

f. Americpji Indians^ 

rural disadvantc'ged whites' 

12. To identify and disseminate employment openingj^ " 



liiformatioD within fhe districts aad x;here ^ 
feasible within the state. 

l'3« To provide information on post-secondary 
vocational, technical pragra© op^cnings 
to hi^h schools vithin the. district. 

14^ To expand part-tix)aa career preparation 

opportunities for those persons over 16 years 
of ^ge by four nx-^ courses per year (two per 
semester) to serve approximately 50-'60 e>ersons« 

The- section to follow will compare in a general way the objectives of the 

NCTI and the ob-^ectives of the Exenplary Project. 7irst , the comparison is to 

indicate that the Project's objectives are coterminous with specif it^ objectives 

of the NCTI and generally with others. Secondly, the comparison will highlight 

those areas of service which the HCTI Area Board chould consider ^^inding when 

Federal f'jnds terminate the project. 

The Exemplary Project Under girds N. C.T.I. 
District Objectives 

The purpose of this 'section of the report is to show that the^roject staff 
menbers, in piirsuing the objectives of the Exemplary Project, have ijpplemonted 
and enhanced the objectives of the NCTI Area District Board, some ^re t^an p^ti^s. 
The Exemplary Proj.ect has carried out objectives which up until the establishment* 
of the Project-had received passing efforts more or less in £he daily routine ac- 
titles of the staff of the Kdl. This review of NCTI, objectives and the objec- 
tives of the Exeffifljlary Project will have implications for the NCTI administration 
and for its services to the District residents after the third year of ^he Exemp- ^ 

lary Project when Federal funding ceases. . * " 

r ' ' ''^^ 

NCTI Pigtrict Objective No. 7^111 Be cbtisldjered first for purposes of this 

^ ^' - - 7-' ^ i ^ * 

report. Objective 7 states .£iiat NCTI is "to provide area leadership, educational 

^ ' » " ' t 

programs, .educktion services, using the District's facilities consistent with the 

institutions' objectives desired by persons of the District". The writing- of the 

\ ' . 



proposal, and the funding of it, ixi which are recognized the staff services and 
activities now provided or provided insufficiently is evidence of leadership. The 
effort Xo reach populations hitherto reached partly or not at all, to assist 
persons with the development of self-awareness and C;areer awareness at all age 
levels is, a new thrust or a long delayed one. A few exampl^ are, providing as- 
sistance to school with materials and demonstrations in the classroom dealing 
with self-awaren^s and career awareness in grades K-14, job exploration workshops 
held at the NCtl where high school students could engage in actual work experience 
in the various laboratories of NCTI^^rking with parents of undecided high school 
seniors and to provide guidance services in the schools where the services were 
either non-existent or were inadequate. At the adult level 16 years and over ser- 
vices were provided to enroJLiees at the Store Froat^School, to per?ons vho case 
to the intake supervisor of the Marathon County ^coial Services, cooperating with 
^jthe Job Services and the Community Action Program, and assisting the Senior Citi- 
zens. The staff of the Project was successful in articulating the efforts of 
the departments yf the NCTI with their counterparts in the public school system. 

The'second district objective for purposes of this evaluation is Objective 
No. 4 which pertakns to assistance to persons in self-evaluation and determination 
of career direction through testing, counseling ^d guidance so that they, may ^ 
through education realise their maximum employment ^potential. Objective No. 4 
was implemented ^r enhanced through the Project staff's efforts with persons tak- 
ing the General Education Devalopmental Testing f^gram and the counseling and 

^ ; - 

educational program that was set up to be followed by the applicant. This ob- 
j active was carried out by working closely with those^^ adults who were enrolled in 



the Adrfft Basic Education Program. Tlie introduction of these persons to self- 
a^^areness and career awareness and the implementaiton ^of^a program of education 

- • . 15 ■ 
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wMch went beyond the basic 3 Rs was an innovation. The entire program with 
schools was in fulfillment of this NCTI objective. This was especially sig- 

nificant in view of the many Small rural schools in thei NCTI District. 

The third NCTI objective of significance to the. Project, Objective No. 5, 
deals with "opportunities to remove deficiencies according to individual needs 
of people who lack adequate proficiency in background courses necessary for suc- 
cess in the vocational or technical curriculum they seek to pursue". Persons in- 
cluded in this objective have been mentioned above. Tl^^Proj^ect staff very defi- 
nately extended themselves in their efforts to seek out and to encourage and assist 
persons with deficiencies. As great as they feel that the need was to seek out 
these persons and to assist them and even though they coordinated their efforts 
with other agencies, their effort proved to be less successful many times due to 

the personal characteristics of the persons to be helped. A more complete des- 
\ 

crip^ion of the efforts of the Project staff will be found in later sections deal- 
ing with "Adults 16 Years and Over", "Women" and "Agencies". The list is sufficient 
and it is most important at this point to point out that the efforts of the Project 
staff have decuoatrated a real need for the NCTI staff and Area Board to give re^^l 
consideration as to how to best serve these populations in their fulfillment of 
their objective. 

The Project staff members were not unmindful of the remaining objectives of 

the NCTI^^and they attempted to^fulfill them as they encountered persons who fell 

into, the respective area of operation delineated by the objectives. However, 

the concerns which prompted the development of the Project where concerns related 

to the 3 objectives of the NCTI described above. ^ % * 

r 

Observations 

The Project is entering its third and final year.* Generally, these Federal 
projects are demonstration projects as the term "Exemplary Project" indicates. 
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It is assuned that Federal fxmde were sought to demonstrate a need and that if 
beneficial results were found that local authorities would provide funding or 
find other sources of funds, to continue to proXride for thjese needs. 

The experiences "of the Project staff clearly indicate that the objectives of 
the NCTI listed above were not being met or met inadequately when offered to the 
populations mentioned above. The following observations are briefly stated in 
preparation for the recommendations to follow:. A fuller treatpient is given in the 
sections to follow in the next chapter. 

1. The >>est intentions and efforts of the Project staff too often were frus- 
tsc^t^ by the per::onai.^aracteristics of those whom they sought to help. 
They were prevented from dealing with them in groups such as those in 
classes or in other captive situations. Most of these persons are^'^^t 
dealjt with on a one to one basis. 

2. The staff found that agencies which dealt with the same prospective clientel 
were cooperative and thar they offered valuable help. 

3. The acceptance of the staff in the elementary and secondary schools and 

the many services rendered is an indication that the services are needed 

very much. Wltnessefs from the small shcools were impressivfe. The larger 

schools appreciated^ the additional seirvices provided as well as the coopera- 

i 

tive use of bibliography and materials of instruction. 

4. The efforts at the ^articulation of instructional activities and programs 
at* the NCTI with those in the secondary schools opened up new vistas for 
instructional personnel at the secondary schools, e.nd the NCTI, as well 

' as for the secondary school students. 
Recocmendatioiis . 

The efforts of the Project staff hay^ been extensive and noteworthy. From 

"17 



the beginning, it was obvious that even with the best intentions and the best 
efforts that the staff could not fulfill completely all the objectives that were 
set forth in the proposal. This is to say that a way must %e f^nd for carrying 
on the work that the staff has so significantly pointed up* Thrs; following recom- 
mendations are presented for the NCTI administration, * i 

J / 

1* The administration of the NCTI should establish a formal liaison with social 
service agencies' dLn order to work with adults for whom the agencies fill a 
primary need. It appears that whenever a primary need is fulfilled for an 
adult the project staff achieved a degree oJe success which would not have been 
gained without the"" cooperation of the agency. 
2» The administration of the NCTI should Bjeek the cooperation of public school 
administrators to establish a position in the Cooperative Educational Ser- 
vices Agencies of the NCTI District to assist schools in ImJ^leLienting Career 
Education* These persons should be qualified to assist with curriculum im- 
plementation .-by means of management by objectives/ 
3. The administration at NCTI should make formal provision for staff to articu- 
late the vocational programs in the secondary schools with th^^vocational- 
technical programs at the NCTI, and to be of assistance to the ^^ersibn "i^the 
Cooperative Educational Service Agencies responsible for Career Education^^ 
,Xhelpublic and if possible, private elementary aild secoiidary schools. 



The following chapter deals with the manner in which the Project staff by 
various means communicated with as many of the public as possible; describes 
selected experiences with the broad area of Adults 16 Years and Over; Women, as 
a separate category of adults; the Project staff's relations with the NCTI staff 
and the Introduction of career education into NCTI classes *as well as the cooper- 
ation, of NCTI staff at the time that *the Project staff was trying to introduce 
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the Career Education cpncept to the clenent^/ and secondary schools and to assist 
with the implementation into the curriculum of the schools; describe the project 
staff's experiences with the introduction of Career Education into the schools and 
finally a review of the' Project personnel in relation to the services performed. 

Another section to follow will deal specifically with the results of the 
tests given in selected schools as- recommended in the Draft Guidelines for the 
Evaluation of Career Education Protgrams. 
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THE SCOPE OF THE PROJECT 

This chapter consists of the 'following seven subsections; Coimaunication, 
Adults 16 Years and Over, Women, Agency Cooperation, NCTI Staff Involvements 
School Participation, and Personnel. Each section deals with an aspect 
of the total effort in which the Project consultants T7ere involved and which 
was evaluated as, best as was possible under the circumstances. After a brief 
description of activities some observations are made and recommendations are 
stated. 

Tl^ fallowing chapter will deal more specifically and at the same time, 
more comprehensively with the work of the project consultants in selected 
*schools. The section on School Participation mentioned above is a general sum- 
mary and was included in order to complete a description of the scope of the 
Project. 

Communications 

The Project staff announced the establishment of the Project and the 
services available from it by means of the media available, newspaper, T.V., 
radio, flyers, a newsletter, handouts and a--fi^aker's bureau* 

They appeared before local service organizations. They worked with parents 
and teachers at conferences and provided displays. ^ 

As time went on they produced more newsletters and ^issued 2,000 flyers 
for 3 educational program^. They appeared as guests on **55" Feedback, a radio 
program and the estimate v/ad that 69,000 persons had viewed it. They also appeared 
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on TV emphasizing Area Employment Trends and Education and Work Opportunities for 
Women • 

They presented the American Pie Forum over the local TV station. 

Workshops, although largely meant for instruction, are^ans, to communication 
when presented successfully. Such was the workshop on New Career ,Oppordtrrt±ties 
fbr Women. ^ j 
^^^^ Career Development displays were presented at meetings of all kinds. Clasecc 
at the NCTI such as "Going Places with Your Personality" were popular. Slide 
presentations produced at the NCTI were thought to be effective coraDuniG^^a^e<''*^^e 
excellent bibliography completed by the Project personnel as well as the materials 
centeri^t NCTI were well received. 
Observations 

Career education may need to be defined more specifically in th€ 
the various publics. It needs to be related to cnncepts that various 
hold, rightly or wrongly. Career Education must be associated in the 
the ^do^us publics with the idea that working is something most of u3 must do to 
exist, that there, are many kinds of careers, that some persons are bel^ter adept 
at somfe careers than others, that interests can be determine^ and chant^el^d. The 
public must know that Career Education is learning about oneself and relating one's 
Interests and abilities 'to occupations "^(work) , to learning in school in general. 
They need to know that Career Education is related to the job market, to ejnployment 
and to the avoidance or diminution of the ranks of the unemployed. ^ ^ 

Successful implementation and assured continuation of Career Education V 

> • t V/ \ 

schools is dependent upon public support. Public support, in addition to an '^^-^ 

■*» ' ' 

preciation of the concept and the manner in which Career Education is implemeiited 

strated when special personnel are to be employed^' 

and additional instructional materials and equipment are to be acquired to im- \ \ 

* * t t) 
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plement the instructional program. 
Recomendations 

It is recommended that a special project be financed to conduct a survey 
that would: 

1. identify all the publi cs of a community relative to theiy concepts of Career 
Education, 

/ 

\. 

2. identify the various publics in relation to those who might profit from 
Career Education, and 

3. determine the degree of support for the implementation of Career Education 
at grade levels K-14 andtifor MUlts^iG years ^and* over* , 

The results of such a survey should enable a school system contemplating 
the introduction of Career Education to deal with the public effectively first, 
as to who understands the concept and is in favor of the adoption of the concept 
and thereby gain support for the idea. Secondly, the identification of prospect- 
ive clientel for the Career Education program arid their attitudes tor^ard it 
would thereby enrable the school srtaff to prepare effectively for dealing with this 
clientel. ^ ^ , . 

Adults 16 Years and Over 

This category. Adult? 16 Years and Over, is' a very broad category. There 
are persons who are 16 years and over who are not in public schools. Neither 
are these people permitted employment In competition, td.th those 18 years and over. 
Still, they are either subject to attendance at vocational schotJls and/or 
are there for special reasons as is illustrated by descriptions to folloi^. 

^urthemmore, there is the ^ult employed, the adult qnderemployed and the 
adult unemployed. There is the matter of women adults ahd men adults. " 

s 

The effort in this project has been directed to^-rard various adult groups. 

t 

The discussion that follows deals with those 16 years and over in a general way. 
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It appears that the expectation was that something for everyone wcMd somehow, 
in some cases at least, crystalize into a given group of «^suf f icient size to work 
with effectively* > • . , 

One of the earlier experiences of the Project consultants was with a group 
of 80 NCTI full-time students who were instructed in the use of the Job Bank. 

A NCTI staff person is assigned to the administration of the General Educa- 
tion Developmental Tests. A general education development preparation class was 
instructed in the interview methods o£^ job application. This class also pro- 
vided the students with an opportunity , to seek answers to general education iii- 
formation questions. ^ 

A girl visually impaired wanting to drop out of school was coun^lsjled to 
remain in school. 

TJie consultants found difficulty in reaching disadvantaged adults. They 
are of the opinion that working with another agency such as the Job Service Of- 
fice or Community Action Program has been more effective b.y assuring definite en- 
rollment of a more cohesive and similar group of participants. 

Some senior citizens have been reached through an effort by the Marathon 
County Public Library. , ^ * 

An effort has been made to reach enrollees in Basic 4dult Education programs 
with career education programs such as self -awareness and career awareness* 

Parents of high school seniors who are undecided as to their future have rc- 

f 

ceived help from the consultant^. r 

The consultants experienced difficulty ^d.th Attendance of meetings for adults 

r 

Apparently experiences differ from city to city. 

Out-^tients at the Marathon County Health Care Center have received help 
from the Project consultants. 

The consultants have provided in-servlee programs for 6 members of the ^ 

-V 
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ConHDunity Action Program Youth Development staff* They ate planning a Joint effort 
working with high school dropouts ♦ 

The consultants have been conducting weekly meeting^ at the^ Store Fronts an 
alternate school program for dropouts from the publir schaQi_§ystem* Ihis Is 
a program supported by VISTA, The Community Action Youth Developmet^t Program and 



the Board of Education. 

The staff is organizing to deal more effectively with rural disadvantaged. 
The Associate Director will coordinate the Basic Education Program because it 
appears that Career Education and Adult Basic Education are geared to the rural 
disadvantaged. ^ 

Observations - ' / 

1. The diverse clientel described above i6 an indication of the problem of 
dealing with the adult in general. Th^g desire to help everyone is adinirable 
but it spreads a limited staff too thih. In addition, the staff has not* the 

~ time to determine the reason for their success or failure in dealing with 
these groups^, ^ 

2. Apparently, there are primary needs more important to many adults than 
Career Education as they see it at a given time.^ Therefore, they take care 
of their primary needs first and education is secpftdary. 

3. The observation of the consultants may have merit that they might deal with 
some adults more effectively by working with other groups. Apparently, or- 
ganizations such as the Job Service Office or the* Coimnunity Action Program 
fulfill the needs of adults or their primary needs. 

4« Store Front Schools have been found effective in some cities. The consul- 
tants have found thus far that the enrollment has not been sufficiently 



stable to offer a program effectively. An attempt flj.ll be made to sta- 
bilize the enrollment* 



^11 be 
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Re comtnendat Ions 

1. Lii&jt the number of categories of Adults 16 Years and Over to be dealt 
^.with. 

2: Coordinate the efforts of the Project*x:on8ultanwS with the staff efforts 
of organizations who geem to command the continued attention of the adult 
clientel they serve. The consultants have had some experience with this. 
Other recommendations appear in the section dn Agencies. 

I 

3. The disadvantaged need to be sought out. For n while they may need to be 
dealt with on a one to on^Jbtts±s. The consultants need to use the case 
study approach and keep records as does any clinician in order to offer 
guidance and to observe and record progress. 

Women 

The movement dealing with the status of women has been -Quf flciently effec- 
tive so that they received thuir sliare of attention among adults by the Project 
consultants. The consultants worked with women^s groups such as the Women^s 
Group at the U,W» Marathon County Center. At a particular time they, met with 
Norma BriggSj, Executive Director of the Governor ^s Coimiission on the Status jof 
Women. On the other end of the spectrum they have had a fair amount of Success 
in working with the Mother *s Club> a welfare group, an AFDC group known as the 
Tuesday Morning Mothers Group. . 

The YWCA has a women's group who call thems/elves Holiday From Apron Strings. 
They viewed the filmstrip "Women Today". 

Tuesday Horning Mother ^s Group viewed the filmstrips "Women Today", "Wn)ncn, 
at Work" and self-awareness film strip - "I-Jhy I Am Afraid To Tell You Who I Am". 

At another time this group viewed the filmstrip "You are Importjmt". 

> 

Tb^^consultants organized a "New Career Options for Women Workshop-Promoting 
the Development of Girls and Women". One hundred and fifty women attended. 
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Another program was organised around trends for women's awareness of the 
status of women and self-awareness • This program was presented in 6-2 hour ses- 
sions with an enrollment of 16 women. The program included the filmstrips, "Women 
Today", "Why Am I Afraid To^Tell You Who I Am", and "You Are Important". 

^ The consultants have met with the members of 'the University of Wisconsin 
Women's Center group to plan activities foy women in the community. ,At the same 
meeting the filmstrip "Women At Work" was presented. Also a plan was developed ^ 
for a workshop on "Sexism in Education". 
Observations 

1. The presH[|^ concern for the status of women, and a working group obviously 
with some prestige i.'a^ given emphasis to career education for women. It is a 
good nucleus to work with and the consultants have capitalized on it to 
their=credit . However, the question arises as to just how much was ac- 
complished. Nonetheless, the illustration bears out jfh: point ruadt 




consultant that working with an established (group gives greater impetus 
to successful career education. 
2. Another established group to v/ork with and* with some success is the Tu. sday 
Morning Mothers Group. This gropp which obviously does' not have th^ ad- 
vantages of the U,W. Women's Center is worthy of the consultants effort. 
Furthermore, a planned program with definite plans for measuring progress 
would be rewarding. ^ 
Recommendation* ^ ' ' 

, 1« Consultants should concentrate on working with the Tuesday Horning Mothers 
Group because they are a disadvantaged group.' If necessary, use the case 
study approach to enable the consultant to be productive as well as to 
measure progress. 
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2, When working \rtth groups^ establish a specific goal br* sCit of goals ^dar 
tennine* whether these were achieved. Detennine methods of fevaluatiori in ad 
vance, possibly with the members of the group. This inauresL ndt only ef- 

9 

fective presentation but assures the group of meeting its nfeeds. 

Agency Cooperation • ^ ^ • 

Project personnel have sought the assistance of agencies in carrying out 
objectives of the "Project. This is very much to their credit and is lljcely to 
be very productive and of permanent value to the NCTI as well. Not all of the 
agencies ti^ay be listed here but the list is an indication of the agencies that 
share an interest in Career Education and education gene^lly. 

Immediately, the consultants conferred with the public schoals of the area. 
Since the schools 'In the Dist)?ict have a district organization of their own (not 
.^j^ce^arily cotennlnus with t^g^^^TI District) the consultants sought the coopera 
«^tibn of the Cooperation Educational Service Agencies (CESA)^. ^ 

The chambers of commerce were sought out in several cities • Business, 
Industry and Education Days were used to an advantage for the schools, the com- 
munity and the purposes of the Project. . , ^ 

The Job Services Office ^ the Community Action Program"^ Group were appealed 
to for assistance and cooperation. WIN and CETA gr'dups were sought out.^ 

The civic clubs such as the Kiwanis Club arid the Lions Clubs served as 
a means of publicizing career education and the purposes ,of the Project. 

The YMCA already had a numbe? of organizations that responded to the appeal 
of the consultants such as the Holiday From Apron Strings Group and the Tuesday 
Morning Mothers Group. . . ' ' 

. The D,W. Marathon County Center wa^ tfie nucleus fcr^ the University of Wis- 
consin Wonjen^s Center and this gt&up appears to he an effective ally in working 
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with w^ften In the coranunity* 

Marathon County Health Care Center and the Marathon County Social Ser- 
vices i^rovide a ^ource of persons whom th§ Project consultants can help. 

The Ma1:atlS55^ County Public Library has a clientel to be served by the Pro- 
ject. Furthermore, the Library has facilities as well as program per9<>nnel to 
piit at the disposal of the Project personnel. ^ 
Observations 

w " ' 

1. The Project staff has successfully gone to various agencies for cooperation. 

9 

2. The agencies have responded generously and opened up doors to various types 
of persons in^^ed of assistance* which the Project staff can offer. 

Recommendations 

l-lCcGtinuG to work with agcncios to procure clientel, 

2. Attempt to integrate the efforts of the agencies and the Project consultants 
when objectives appear to merg6 or are duplicated. The professionals in 
all these agencies have similar problems concerning clientel and their prob- 
lems are similar to those of the Project personnel. Therefore, pool resource 
,as often as possible* 

NCTI Staff 

The part played by ^he instrucffonal staff and the administration of the NCTI 
is vital"^t0^the•contiau«^^oh^ of Career Education after the Project is tetminated. 
Whereas the Project staff members have demonstrated Career Education in some of 
the classes of the vocational and technical programs, a niimber. of vocational ^and 
technical program instructors have begim"Tb incorporate Career Education in t^Jr^ir" 
courses,. This experience on the part.^f the^ecjinical Inst it ut^^^ins true t^ en- 
ables them to deal understandingly wJbt^h their counterparts in the public achools 
as well as adult groups. 



The Director and Associate Director have participated in the articulation 
meetings of the Local Vocational Education Coordinators (LVEC)* 

The Project consultants conducted sessions with classes, demonstr^ated ma- 
teri€ils and conducted individual counseling as a mea^is of incorporating Career 
Education into several NCTI programs. 

The Project personnel arranged articulation meetings to be he3^ between in- 
structors, at the NCTI and representatives from 17 district hl^^schools. 

Tours at the NCTI were arranged for students and parents • A Cluster Buster 
Symposium in marketing, and contests in business and agricultiire were held. As 
a. joint effort between the business department and the Project, a questionaire 
to determine the time and subjects for further group articulation was presented 
to approximately 50 secondary school business education teachers at the Wiscon- 
sin Education Association meeting. 
/ Efforts have been zade to involve instructors at NCTI in Career Education 
through the semester in-service meetings, flyers were produced, planning meetingG 
conducted, and classroom demonstrations held. Racks containing brochures with 
information on programs at NCTI and career development have been delivered to 
schools as a cooperative effort to student services. 

Slide tape presentations deve^ped by NCTI instructors at the Career Ex- 
ploration Workshop For Students Involved in Youth Work Experi^ce Programs h^ive 
,l>^en completed and. are currently being circtil^^ed through the NCTI library. 
Observations ^ 

The Project staff has been permitted by instructors in the vocational and 
technical instructional programs t^f^d^nonstrate Career Education in their classes 

A few instructors are beginning to introduce Career Education in their class 
at levels where Career Education can make a contributioh. 

- / , . 

c I 
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Recommendat ions • 

!• Continue to maintain and develop still further articulation between the 

Project staff efforts and instructional personnel of the NCTI. 
2* Continue to use the resources and instructional personnel of NCTI .for the 
development of materials of instruction for use, in the public schools. 

School Participation 
Tfils section is intended to serve as^ a sunroary review of the manner in 
which the schools were opened up to the Project <vciisultants. It also points up . 
arrangements provided in the schools intentionally or otherwise by means of which 
the Project conpultants served the faculty and students of these schools. The 
next chapter will deal with some of the results in the schools of cne efforts of 
the Project staff. 

There were a total of 25 schools involved, including elementary schools, 
middle schools, junior high schqols, senior high schools and a Catholic elemen- 
tary school and a Catholic high school. All schools in the ^istrict were in- 
vited to join the Project* 

These schools were serviced by five con°ultants representing the Project. 
One of these consultants was located originslly at Medford /Wisconsin to serve 
the schools in the Western and Northern reaches of- the- NCTI District. Another 
consultant was located at Antigo to serve the schools in the Eastern and North- 
eastern reaches of the District. The other three consultants served at the Cen- 
tral area and Southern section of the District • 

After a general meeting tf all school administrators letters were sent 
out again inviting all schools to participate. Enclosed in the letter was a 
copy of Potential Services in Career Education. The information provided by " ^ 
the responses to this inquiry f)las a Careers Inventoj:^ Survey for high school* 



30 



seniors •served as entrees to v;ork with the. schools. An additional activity 
to encourage participation in the Project was the Career Exploration Workshop 
held at'the NCTI. Students attended and were able to try out th^ir abilities, 
skills, and interests in the various departments pf instruction at the KCTI., 
Generally, after superintendents of schools were s^jLsfied with the 

intent of the Project, consultants, and the scope of the program projected 

t * 

by the consultants, the consultantg met with counselors, EVEC^s and teachers^ 
The school cotnselors were looked to by the consultants as the coordinators or 
the persons to run interference for them with teacTiers and administrators. 
In some, instances the administration selected Career Education Comnittees. 
The comsultants found that their activities were more successful in those 
schoo^^where the administrators continued to manifest a vital interest in 
the Project. . ^ " 

Project consultants had relatively free access to teachers. ConJ^ultants 
"orked with entire departments of subjecft"- matter groups, grade level 
eachers and with individual teachers. In some instances. Project! consul- 
tants met with individual teachers by appointment and in other instar^^*? 
the ci)nsultants were available in a given room and teachers were able to 
confer with them at their convenience. JIany .times the lunch hour was the 
most convenient time for the teachers to confer with the cnnsultant. One^ 
school system provided substitute teachers to permit the regular teachers to 
attend meetings that extended over a period of 3 days. It would appear that 
more school systems could organize for scheduled in-seryice purposes as * 
did the school system just mentioned if not for so ex^iended a period of 
time.. 

The purpose of this evaluation is not to^ review in detail all of the a'ctd;^-' 
ities in the schools. These can be found in the quarterly reports issued by. 



Project director, Dr. Russell Paulson. 

The career iriterest surveys completed by high school seniors and the Po- 
tential Seirvlces ijcTp^eer Education provided the scope of services available 
from the Ptoject Consultants. The Proj-ect has an ut^nsi'^e. library of instruct- 
ional materials and equipment to loan to schools'. In addition, courses were s, 
offered for credit in cooperation with U.W. -Stout. Classroom demonstrations 
were conducted by means of mini-courses. 

The activities that were developed by the respective school faculties and 
students are of interest. Again, a detailed J.isting and description is not the 
intent of this report. However, some highlights are in order. One school sys- 
tem organized a mobile unit to move among the elementary schools to give student 
the experience of taking simple equipment apart and to put it together again. 
Another school developed a career program for retarded children. 

Another school system set up a two week workshop to develop an 80 page 
handbook which included guidelines, objectives and goals to be adopted by the 
school administration to be used system wide. Tor the same commuilty the Pro- 
fessional Women* s Club volunteered help to implement the Career Education pro- 
gram in the schoola. • 

One of the area school systems set up a 3 day "Community-Schools Career Edu 
cation" program. Substitute teaphers were provided. Durlcfg this time classroom 
demonstrations were given, panel discussions were held involving students and 
,teachers. Instructional materials and audio-visual presentations were set up 
for students and teachers. * ^ 

New teachers needed to be introduced to and orientedr»to Career Education. 

V 

A special effort was made in one system ^li^ means to carrying* on effectively 
where a previous teacher had left off. 





Career Resource Guides and Community Resources Guides have been developed 
by several schools • 

Career Development, Days for students and faculty have been set aside by some 
schools* 

•f - • ' . 

Other schools have seen the necessity for the establishment of Parent-Teacher 

Conferences and often in connection with these conferences information films have 

been shown such as "Future Shock" and "The World of Work". 

In some instances consultants have been available to students, parents, and 
teachers meeting together. 

Faculty members at one school indicated that materials of instruction were ' 
more important for high school teachers whereas elementary school teachers rated 
in-service education more important • ^ 

Coordination among agencies serving the entire coTnimtnity is an effective 
aid to Career Education. In one community, all the agencies serving the commun- 
ity participated in the development of a Community Services Guide to__Career Edu- 
cation* • . 

Smaller schools have found it profitable to arrange for schools coming to a 
convenient locatioiwto make better use of the consultant's time and also to share 
ideas. ' 

' A draft copy of the "Guidelines for the Evaluation of Career Education Pro- 
grams" was introduced during the latter part of the year* An attempt was made 
to establish treatment and contrbl groups of some of the schools to determine any 
progress in Career Education especially in self-awareness and career awareness. 
Commercially produced tests recommended in the Guidelines were used. Test results 
will be discussed in the Chapter on Evaluation at Grade Levels 3,5,9, and 12. 

The consultants were of the opinion that the adults with when; they had worked 
wo^Jld not respond either in groups or as individuals to the ^'^l^^^ tests such as. 
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recoumended by the ..G^delines . 

There Is no doubt that the school systems of the NCXI-District have^ac=-_ 

cepted the Project consultants aad the concept of Career Education, although 

they may have donee so vd.th varying degrees of effectiveness. Furthermore, 

their accpetance is testimony also to the leadership and services provided by the 

Project personnel* 

Observations 

1, Project consultants have observed that they are most satisfied with their , 



progress at those schools where there is active support by the administra- 
tior. 

2. One of the schools in which it appears that a great effort was concentrated 
in 2 or 3 days provided substitute teachers to release teachers r:o work with 
Gtudents and parents on Career Education projects. ^ 

'/ 

3. Atiother school made a special effort at the induction and oriencation of 
new teacher? to the program. 

I ^ - 

r-'*" 3. Oiie of th3. superintendents of, school^ appointed a Career Education Com^ilttee 
consisting of faculty members to develop a guide for the introduction of 
Career Education into the system. 
5. In some coir/jiunities citizens organizations participate in the development 
of coroTJunity resource guides. 
Rfeccmoend^tions ^ ' \ . 

, i. Be sure that someone in a school system keeps the top administration in- 
formed about the *progress'Of Career Education in a -given system. 
^» Encourage the release of teachers from classes by means of substitute 

teachers. ^ 
3., the iiyiuction and orient a tloi^ of new teachers Into Career Education should 
be encouraged. . - 
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4. The appointment of comraittees of teachers to plan guides for Career Educa- 



tion for adoption by the administration should, be encouraged. Such teacher 
participation in policy formation makes for continued success of Career Edu- 
cation. 

5. Encourage ad !ioc citizen participation wherever they can help develop and 
strengthen the program. ^* 

v) Personnel 

The Director and Associate Director have attended national conferences to 



keep abreast of developments in Career Education. The Director has offered UW- 
Stout credit courses in Curriculum and Methods in Career Education. Consultancys 
have attended state wide meetings of the Personnel and Guidance Association. 

Director and Associate Director have conducted articulation v.^t^tincvj x/ith ItCTl 
staff and LVECs. 

The consultants have directed in-service programs in the public schools an J . 
with individuals. 

Business, Industry, Education Days sponsored by chambers of coroner Cci have 
bean attended by the consultants. 

Service clubs have been opened to them to tell their story. 

They have presented filmstrip showings at the Marathon County Public Lib- 
ra'ry. ^ 

The incorporaition of Career Education into the class'es at NCTI is to their 
credit. 

A review of their dealings with agencies attests to their accpetance with 

them. 

They have been willing to meet with parents of undecided seniors, and v;ith 
teachers during their noon hour. / 
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As a means of atiuractlng more adults to th^ Career Education program, and 
as a more efficieiit, Effective use ^ personnel, ^he /vsspciate Director has also 
taken on the responsibilities as Coordinator of Adult Basic Education at KCTI. 
Since both progiams aie geared for the i;ural disadvantaged adult, many of the 
re»9i/onsibilities are overlapping. Another consultant will be hired to assuiae the 
consultaiiC role in the schools which have been served by the Associate Director. 

A review of the previous sections dealing with Communication, Agency Coopcia- 

tlon. Adults 16 Years and Over, Women, v7orking with t he NCTI staff a nd the coa - 

sultaacs ./oik vith Chd schools JLeaves no doubt that much has been accomplished b^ 

the consultants in their attempt to malce the communities and schools Caree5?->^duca- 

tion conscious. However, this is largely based^^on^^serva^ and observation 

that is based or. che evaludtors assum3d km^v/ledge of conditions prior to the in- 

troductifai oi' the Career Education concept. ^ ^ \ 

Gbscin'acious 
« 

1. An integral paj^^ the evaluation of personnel is the establishment of ob- 
jectives , .activities and outcomes as butli^ed above for a projecu and its 
.,i,^b»idiary parts. . ' ' • 

2ft Job analysis and^ob descriptions are important to employer as well as to 
6j;iployee in that each must know what is to be done and what is conslcUieJ 
to be normal accomplishment^^ . ^ ' 

5. Growth of personnel arid special advancements of the project are designated 

B3 job' expectations, izr otKar words, expectations over and above the normal 

activities to get a given job done. The latter may be illustrated by a 

consultant working with a school. The normal outcome would be for teachers 

to accept the instruction of a consultant and apply it in the school ^tu- 
« 

ation. The student would do well on a career developmen^ assessment a.aJ 
p» eats would seek the consultants* counsel.' However, the d^darermination of 
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the administration to release a teacher or teachers and employ substitute 



teachers or add, paraprof essionals to^nable the teachers to attend an in-* 
service program or to plan or to produce special materials would be con- 
sidered a job escpectation ovet and above the normal routine » 
The evaluation of cousulting and supervisory personnel presents some hazards 
because the object of change is twice removed and often more* In other words, 
between the administrator or the Project Director aiid the student or the recipient^ 

are the consultants and the teacher and passib.ly.jcithera^ Consjequeatly.^ _.a ,cjanstant_ 

alertness to obstacles of success and changes by all personnel involved is impor- 
tant. Frequent consultations between teachers and consultants and the consultants 
and the Director are most important and the establishment of formalized procedures 
to maintain such communication is imperative. The consultants were aware of com- 
munication problems and as a result located their offices in Watisau rather than 
reducing distance by locating consultants in regional offices • Furthermore, 
they soon discovered that leach had. special contributions to make an(J .then not only 
pooled their resources but also worked in each other's teirritories. 

Recommendations ' , - ( 

1. That objectives^ activities and outcomes established for the Project and 
for subsidiary aspects of the Project be constituted as an aspect of per- 
sonnel evaluation. 

a. Specific objectives for subsidiary components of the Project along with 
the general objectives should be stated. Objectives are guides to ac-^ 
tion and the greater the specificity, the mgre likely is the effort of 
the consultant to be directly related to the ojbective. 
'b*^ Specific anticipated activities to be conduc^^ed^y the consultants in 
thelt efforts to carry out the purposes of the Project should be stated. 
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These^imay be modified from time to time circumstances may dictate. 



c. Specific outcomes anticapated by the consultants resulting from their 
efforts to implement the objective^^ should be listed. Variation in 
outcomes can always be explained and many times justified. Outcomes 
may be demonstration of skills, verbal or physical, they may be inter- 
actions among persons and they may be written resposes* 
These statements submitted prior to the signing of an evaluation agreemant. 
will serve as .J*? .^^^j-y^^S. 9 cons^ensiis between thfe ErpiJect pets.^i^nel 

ani3 the evaluation team concerning the method of evaluation. 

The benefit to.be derived from such an understanding would enable: 

a. the consultants to pursue a more purposeful activity 

b. the consultants to direct their energies to specific targets 

c. the evaluators to eliminate as much bias as possible since they would be 
looking for specific pre and post data rather than relying on the pos- 
sibility that they may un4erstand the clienteles previous condition. 

Specific items furnished by the consultants to be evaluated would be more 
likely to produce a more fair assessment of the consultant's efforts. The evalu- 
ators should evaluate on the basis of stated anticipated outcomes and of the effor 
put forth by the consultants rather than the evaluators expected outcomes arid the 
effort the evaluators think fche consultant should have put forth. The latter 
point of ^what the evaluators believe Xhe consultant should .have done in preference 
to what he did is a question that can be discussed after the evaluation, 

2. That job analysis and job descriptions be Instituted to enable consultants 
to know what is considered normal accomplishment. 

3. That. expectations of job performance beyond the goals of normal accomplish- 
ment be established. 

4. That formalized procedures for constant communication be maintained 
and Improved whenever possible. 
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EVALUATION AT GRADE LEVELS 3,6,9, and 12 

The project staff has been xjorking intently for abojx^ one an^ one-half 
years with the' school staffs introducing Career Education into the curriculum. 
Teachers, not all, have accepted the challenge to implement Career Education 
and have taken it on as an additional assignment to their regular duties in 
most instances. Sources for Career Education have been books, articles, lec- 
tures, films, workshops and a course offered by the University of Wisconsin- 
Stout ♦ After 13 months of Project activity som^ measure of progress is in 
order. 

Standardized tests were introduced as a means of evaluation because , 
through the standardization process objectives have been arrived at which ar^ 
generally accepted. All students are responding to the same questions; In 
fairness to those associated with the Project the use of standarcUzed tests 
was not anticipated in the evaluation in the Project proposal, in fact, the 
Guidelines had not been issued. Consequently, there are bound to be varia- 
ti6ns in what different teachers taught and counselors advised. Nevertheless 
the attempt to use standardized tests may be a more fair basis for evaluation 

to the j^rantor of funds as well as to teachers, students and Frojecc 
personnel than on the spot observation by the evaliiators. 

Furthermore, this is an evaluation midway through the three year Project. 
The' use of standardized tests at this timfe will set more specific goals, 
will cause teachers to be more selective in their i^eans of implementation, 
and be more conscious of specific outcomes the third year in their 
participation in the Project. 

The tests recommended by the Guidelines were submitted to the consul- 
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tants for their evaluation In terms of irfiich test, in their opinion, vas 
appropriate to i c.isura what had been implemented in the curriculums 
including cho counsel -fng acClvities. They selected the Self -Observation 
c. -.io« Vprm A, 1974 published by the 'National Testing <?crvlce, Arlington, 
Virginia, apd Career Education Cognitive Questionnaire Form A, 1974 published 
by the Minnesota Research Coordinating 'Unit For Vocational Education,^ Univer- 
sity of Minnesota, Minneapolis, for grades 3 and 6. The Assessment of Career 
Develo pm ent test o f the American College Testing Progr am and publish ed by 



Houghton Mifflin Company, Geneva, TlUnols, vas selected for grades 9 and 12 
because the Project staff was of the opinion that its cotitents were appropriate 
for the Career Education content- Impleflientpd 'in the currlcnlums of thg schools 
ami <n(.rodnreJ by the counselors in^J:heir counseling. ' 

The introduction of these tests after 18 months of Project progress 
created some problems since neither the Project ^taff^or the school staffs 
were prepared for it. Nor did the Project staff anticipate their selection 
of treatment and control schools. Consequently, the Project staff selected 
those schools' as treattaent schools and grade levels at which the teachers 
and administration had been most receptive to Career Eduction ai^d had done some 
implementing. Schools and grades selected for the control group were those 
-who were not opposed to any implementatibn but who, in the opinion of the 
Project staff, in comparison with the schools in the treatment group had not 
progressed as far in their implementation efforts and who were not opposed to 
administering the tests. 

The groups were not selected as being representative of all the ele- 
mentary and secondary schools in the North Central Technical Institute 
District. They represent only themselves. They aire equated only in the sense 
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that all aire schools in rural farm and non-farm areas with a similar ethnic 
population mix. To repeat » theire are a number of reasons for the introduction 
of these tests; one, the ,test method appeaired to provide a more objective ^ 
evaluation of the progress, if any, of th^ implementation o« Career Education 
into the schools than jan on the spot observation; two, to acquaint Project 
staff and school staffs with these tests; apd three, to establish more definite 
goals-,- to-^ssdat teachtu^-jand. c^un^^ be^.moire„ selective JLn their methods 

of iTnplomoutat-ion, and tgr_t?6acherR and coun^olor^. ^xxJ-ve mo.:o ^o,.«< -T .>nc,-J 

pursued outcomes for the final year of the Project, 

0 * 

The sections to follow will deal with the test .results for Self 
'Awareness - Grades 3 and 6, Career Awareness^- Grades 3 and 6 and Assessment 
For Career Development - Grades 9 and 12. , " 

t r 

SELF AWARENESS ' . 
GRADES 3 AND 6 

The-variables with which the evaluation was concerned ^gr Grades 3 
and 6 included Self Acceptance, Self Security, Social Maturity,, Social 
Confidence, 'School affiliation, Teacher Affiliation, Peer Affiliation and 
Achievement Uotivation. Waturally, the test results were given in scores 
although, for purposes of this evalJ|ation and for the sake of brevity, the 
results will be given in terns of the significant differences of the m^ns^^ 
between the control and treatment groups.'* 

Grade 3 , \ 

The variables with which the evaluation was concerned for grades 3 were 
Self-Acceptance, Social Maturity. School Af f ilisntion, Self Security and v 
Achievement Motivation. High and low scores' identify children as follows: 



*See statistician's note at the end of the chapter. 
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Self Acceptance ; Children with high scores view tliemselves 
positively and attribute to themselves qualities of happiness, 
importance and general competence* They see themselves as being 
valued by peers, family, and teachers. Children with low scores 
see themselves as unhappy » lacking in general competence and of 
little importance to others. 

Social Ilaturity : 'ChdLldren with high scores on tffiLs scale know 
how they ate' supposed to think and feel in a variety of social 
s^ituations. They have learned the importance .^of such notions 
asx"f airplay," "sharing/'* perseVerance, ' ''helpfulness, and 
"generosity." Children with low scores on thlis ec^^ have^ 
not learned these notions and are likely to evidence behaviors 
j:hat most adults would characterize as selfish, inconsiderate or 
immature. . 

School Affiliation ^ Children^with high scores view school as 
a positive influence ^ in their lives* They enjoy going Xo S| 
school, and they enjoy the activities associated wi^ school* ,^ 
Children with low scores ytfew school as an unhappy fiace to be. 
They do not enjoy nost school related activities' and are ' * * 

negative about the importance of school in their l£yes* 

Self-Security : Children with high scores report a high l^vel pt 
emotional confidence or stability. They feel that they ate in * 
reasonable control of the factors that affect their lives 
and spend little tine worrying over 'possible troubles. Children 
w ith low scores on this scale vary a great deal. They are concerned 
tliat^mething bad may happen and report feelings of nervouSne^aX 

AchieV^ent Motivation ; This is a. special 6paje, relating achievement 
and ability to sel|< concept. High scores indicate increased 
"probability that t^e child will achieve well with relation to ability, 
'Idw scores indicate' increased probability that the. child will tiot 
achieve as well as wight be expected on the basis. of his ability. 
This scale id consider^ to be experimental i we ikcorp^nd that 

::s use fo^ individual ^^essment be deferred pending the results 
ot our current program of- confirmatory analysis. y 

^ •^ - . 

Table I presents the <^a for Self-Awareness for "Sr^cLes 3 at the Primary. . 
.Level. The data are presented in terms of the sifnificant differences of 
the etatlstical raeau? of the control and treatment groups. 




TABLE I 

SUlS'IASt.Y OF TEST RESULTS FOR SELF AHAREIIESS FOR GRADES THREE 



Vkriable 


Sample Mean 
For Control Group 


Sample -lean For 
Treatment Grdup > 


t-Value 
2 df's 


Significance 
Level 


Self- 

Acceptance 


49*64 


50.46 


.19673 


A* 


Social 
llaturity 


52.13 ' 


50. S3 


-.32812^? 


A 


"^School 
Affiliation 


47.89 


45.15 

i 


-.5334 


A 


Self ' 
Security 


52.55 


53.00 


-.16766 


A 


Achievement 
Motivation 


1 

48,79 


• 48^7 


-.19621 


A 



-A - Significance level greater than 15^ v 



Test Interpretation 

There are no significant differences between the coptrol and treatment 



groups . 
Observations 



That there are no significant differences between the control and 
treatment groups is not surprising. At this grade level teachers may still 
be more conscious of the variables included under the classification of 
self awareness, more so than teachers at the more advanced grsie levels. Con- 
sequent ly, the treatment group teachers may not have differed much in their 
e^orts from those of the control group, particularly so^ since the teachers ^ 
did not anticipate a testing of their efforts t^en they joined the Prpj'ect. 

Furthei^re, the very broa4 spectrum of the Project dealing \TLth many 
publics of which the schools were only one public and grade 3 only one 
of 12 levels ^f thi^s public may have prevented the Project staff from devoting 

^ • -. , . 
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sufficient time to this grade levels 



Dealing' with fewer publics and a deternlnatlon of ^^pecific objectives 
and outcomes at the beginning of the Project probably would have produced 
more identifiable results* ^ 

Some of the observations made bytor. Billie Rader in the following . . 
«<rsecticfh on Career Awareness, Grades 3 and 6 may be applicable here. 

- Grade Six - « ^ 

The additional variables for grades 6 were Social Confidence, Teacher 
Affiliation and Peer Affiliation. High and low scores identify children as 
follows: 

Social Cogfideace ; Children with high scores on this scale feel 
confident of their ability to relate successfully in social 
situations. They feel confident that they can make friends easily. 
Children with low scores have difficulty making friends, Jo not 
feel valued by others ^d see other people as being more socially 
adept than themselves. 

Teacher Affiliation : Children with high scores on this scale like 
their teachers. They see the teacher as helpful, attentive, 
understanding and generous. Children with low scores see the teacher 
as arbitrary, inconsiderate of children, and/or as a source of 
emotional pain. ' 

Peer Affiliation; Children with high scores on this scale, 
consider their relationships with other children to be both of — 
high duality and of considerable importance to them.* They see 
themselves as approved and- valued by their peers. They like 
to be with othi^jr children. Children with low scores do not see 
their peer relationship as an asset. They see other children 
as unfriendly. They have few friends knd do not accept the 
responsibilities of friendship. 

Table II presents the data for Self Awareness for Grades 6 at the 

Intermediate Level. The data are presented in terms of the sicaif leant 

differences of the statistical means of the control and treatment groups. 



TABLE II 

SUIWARY OF TEST RESULTS FOR SELF AWARENESS FOR GRADES 6 



Variables 


Sanple ! leans 
For Control firniip 


Sanple lieans For 
Trpatnent ficoup-J — 


t -Value 

,2 ars... 


Significance 
... l<evel 


Self 

Acceptance 


52.63 , 


52.76 


.08585 


A* 


Self ' 


50.83 


50.42 


-.20901 


A 


Social 
...Ilabirity 


53.69 


52.49 


-1.0270 


A 


Social 
Confidence 


55.07 


54.42 


-.2919 


A 


School ^ 
AfflliAtion 


47.56 


50.68 


2.1349 


A 


Teacher 
Affiliation 


51.16 


,50.22 


-3.8923 


.06 


Peer 

Affillntion 


53.30 


53.01 


-.43224 


• A 


Achievement 
Motivation 


49.71 


50.66 


1.42636 • 


A 



*A Significance level greater than .15 

Test Interpretation 

Students in the treatment group of schools saw their teachers as 
nore helpful, attentive, understanding and generous than the fstudents in 
the control group schools. The difference x-;as statistically significant. 
It uas the only variable statistically significantly different among the 
8 variables. 
Observat ion 

A further investigation into the selection and enployiaent of teachers 
as well as an investigation of the envirdnoents of the treatment school3 
and control schools for teachers and students may reveal the reason for 
the differences. . 



CAREER AWARENESS 
GRADE LEVELS 3 AITO 6 



V 



This section will vary in format fron the others. Dr. Billie Radet, 
senior author of the Career Education Cognitive Questionnaire handscored 
the Prlmry and Intermediate Level Tests and wrote an analysis and interpre- 
tation of the tests along with making some observations h3 a result of his 
experiences. Consequently, this section consists largely of quotes fron 
his report. 

The test for the Primary Level was designed to meauure the competencies 
of identification, recognition, and multiple discrimination. It measures 
the following types of awareness concepts. 1) industries and job 'titles, 
2) occupational leve^,^ 3) v/orker ability requirements. A) worker satis- 
faction, and 5) working conditions. ^ ^ . ^ 

The test for the Intermediate Level measures the following types of 

awareness conceptjs*: ' 1) industries tod job titles, ?) occupational and 

""educational levels, worker abilities and requirements, scttool subjects as 

they relate to work requirements, worker satisfaction, working conditions, 

and decision making process • 

Table III shows that for third grade stu- 
dents the experimental, group obtained 
a higher mean score than -did the control 
group. The^T-test for significant dif- 
ference between control and* experimental 
groups showed a significance of .20 
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TABLi: III 



MEANS FOR CONTROL VS. EXPERHMWAL, T-VALUES, AND 
SIGN^ICAMCE FOR GRADES THREE AND SIX 



Grade 


Control 


Experlcental 


T-Value ' 


Significance 




X 


X 






3 


16.45 


16.3 


.883 


.20 




29.9 


29.2 


j 1.662 


.050 



This difference wo?lid not normally be considered 
statistically significant. Another way of 
interpreting this level of significance is that 
the results 'obtained could be expected to occur 
by chance 20% of the time. 

The data for sixth graders showed that the 
control group obtained a higher mean score than 
did the experimental group. The difference in 
mean scores of 0.7 was found to be significant 
at the .05 level. 

Test Interpretation 

Dr. Rader gives the following interpretation: 

1. ^*'*Career Education instruction in the experimental 

schools may. have been ineffective: In other 

words, there may not have been any real instructional 

differences between experimet^al and control schools. 

2. The Career Education instruction in experimental 
schools may not have been as intensive as needed 
to make an Impact on students. 

* \ 

' m 

3. Control school children may have received more 
career education outside the classroom than the 
experimental students. This happens wh^re parents 
of control students are blue-collar x^orkers. 

A. Validity studies have shown that there is a positive 
relationship between a father's occupational level, 
and student *s mean score and father's education and 
student's mean .score. If there were vast differences 
between experimental and control groups in father '.s 
occupation anti education, one could expect that a 
difference would occur bet\^een experimental student's 
mean score and control student's mean score withoutr 
consideration of the amount of career education 
instruction. 
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Dr* Rader cites research in other states to substantiate his analysis. 

» * '* , 

The results of this evaluation are not unlike 

those obtained by numerous evaluators across the 
country, rlichigan and Ohio evaluators ob- 
tained similar results in very large career 
education studies. They found that in Ohio^s 
four major cities-Toledo, Cleveland, Clncin- 
atti, and Alcron, where the career education 
emphasis, costs an average of twenty-five 
dollars per student, there v/ere no significant 
differences between those who receive 
specific career education Instruction and 
those who did not. 

Dr. Rader comments on problems In career education that he encounters 
in his research. 



There are problems in career education that 
I an presently researching. < In the develop- 
ment of a career education evaluation 
instrument, a person can only sample the 
knowledge identified as iitiportant to career 
education instruction. The questions selected 
to tap the identified knowledge may or may 
not^have been_ specifically taught in the 
*' classroom* As an example, students may be 
asked on an examination to identify a specific 
tool with a specific occupation. Unless 
children h^ive been shown the exact tool and . 
told the name of the occupation, it is unlikely/ 
. that they will be able to answer the question ( 
'Correctly. ChilcUren appear unable to transfer 
and relate one occupation with another. This 
y is especially true In the* elementary schools 
where children are shown one tool and given an 
.explanation about it, and then given an examina- 
tion showing another tool and another occupation. 

Dr. Rader then offers the following strongly held conviction. 

Possibly career education cannot be taught 
effectively in the elementary schools without 
a great amount of specific emphasis on the 
concepts n< It has been shora through several 
major evaluations, including some I have done, 
that integration of career education with other 
classroom subjects is not effective^ Career Edu- 
cation must be taiight as a separate l5;itensive 
session \7±th equal time and emphasis as other 
classroom courses. 
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Observations 

The results from the Career Education Cognitive Questionnaire in some 
respects are not surprising for several reasons • First, the use of tests 
as a means of evaluating the introduction of Career Education in givei/ 
schools in the HCTI District was not anticipated by the teachers nor the 
Project consultants. Secondly, the choice of the treatment and control 
schools for testing purposes, while deliberate, V7as, in part, because 
the school staffs were willing to cooperate. Thirdly, the tests were 
given at the midway point in the life of the Project and instruction was n<?t 
complete. Concepts taught may not have been clearly de^ined^ at this point 
In time and specific outcomes may not have been realized. 

Dr. Rader's observations concerning the relationship between fathers' 
occupational level ^d students' mean score and fathers' education 
and? students' mean score may or may not be applicable to these students who 
come from rural non-farm and farm homes. Unlike many city students, these 
students come from homes whfere there is a great deal of self-reliance when 
it comes to maintenance and repair and the use of the respective tools and 
equipment . 

/ The evaluators also hold the strong conviction that there is need for 
a great amount of specific emphasis on concepts. Whether these concepts 
should be taught in separate courses remains to be seen. 

r 

Obviously, there are a number of variables which cannot be controlled 

in Career Education instruction 4a the various schools during this last ^ 
* • 

year of the Project. Improvements in the effectiveness of instruction and 
cotnaseling can be achieved by means of setting specific goals, improvement 
in the selection and use of methods and the pursuit of anticipated outcomes, 
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CAREER DEVELOPI-ffillT ASSESSMENT GRADES 9 and 12 , 

\ -V 

^'The assessment of the students* ability to pursue his career 

developnent in the treatnent and control schools was based on his knowledge 
of occupational characteristics.^ his knowledge of occupational preparation 
requirements, a'""g3neral summary of exploratory occupational experiences, 

r 

his career planning knowledge, his career planning involvement and his 
exploratory occupational Experiences related to occujpational clusters. 
Grade Mine " ""^^^ 

Table IV presents the data for Grade 9 for the students' knox/ledge of 
occupational characteristics, their knowledge of occupational preparation 
requirements J a general summary of exploratory occupational experiences, 
their career planning knowledge and their career planning involvement. 
The data are presented in terms of the significant statistical difference 
of the means of the control and treatment groups. 

< TABLE IV" 

SUiniARY OF TEST RESULTS FOR OCCUPATIONAL CHARACTERISTICS, 
OCCJPATIOilAL PREPARATION REQUIPOEIIFJTS, A GEi^IERAL SUIRIARY OF 
EXPLORATORY OCCUPATIONAL EXPERIEl-ICES , CAREER PLAiri«NG ICNOT-JLEDGE 
ArD CAREER PLAlcilNG INVOI^VEI^MsIT FOR GPvADIJS :iliE 



\fariables 

V 


Sample Means 
for Control Group 


Saciple Ileans for 
Treatment Group 


t-Value 
2 df's" 


Significance 
Level 


Occupational 
Characteristics ' 


34.46 


35. U ' 


.4905 


A*' 


Occupational 

Preparation 

Requirements 


c 

^0.30 






.07 

A. 


General Summary of 
Exploratory Occupa- 
tional 'l::pcricuces 


1.75 


1.75 


0 


*A 


* Career Planning 
Knowledge ^ 


23.62 


25..56 


3.9190 


.06 


Cang^er Planning 
Involvement 


1^66 


i.si 


16.0000 
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Test Interpretation . ' ^ 

The treatment group schools' perfotmed statistically significantly 
better in terms of knowledge of occupational preparation reqairements, 
career planning knowledge and career planning involvement • 

There was no difference between the two groups in terms of exploration 
of occupational experiences. 
Observation 

The fact that these students came from rural farri and non-faru homes 
may account for the two groups not to differ statistically significantly in 
terms of knowledge of occupational characteristics and lack of exploratory 
occupational experiences. This finding may have Ijaplieations for the 
problems small rural^ schools have to provide this knowledge and experience. 

Table V presents the data relative to exploratory occupational expe- 
riences related to occupational clusters.' The data are presented in terms of 
the significant statistical differences of the means of the control and 



treatment groups for. Grade 9. 



TABLE V 



SUIdrlARY OF TEST RESULTS RELATIVE TO EXPLORATORY OCCUPATIONAL EXPERIEIJCES 
RELATED TO OCCUPATIOl'IAL CLUSTERS FOR GRADES NINE 



Var}.able 


Sample Means 
For Control Group 


Sample Means For 
treatment Group 


t-Value 
2 d|^s 


Si^if icance 
Level ■ 


Social, Health 6 

Personal Service 

■ 


1.70 

s 


1.78 


.799^ 


A* 


^ Business Sales & 
llanagement 


1.76 


1.69 


-.9900 


A 


Business Operati 


1.66 


1.67 


-.4000 


A 


Technologies &^ 
Trades-. 


1.83 


1.89 


- .54717 


A 


JIatui:al> Social 
& Medical Sciend 


es , 1.72 

1 ■ 


1.62 


1.6610 


A 


Creative & Affiliated 
Arts 1 1*31 


1.79 


-.2150 


A 



ERIC 



*A - Significance level greater than .15 
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Test Interpretation 

There is no statistically significant difference between the two 
groups* The data bear out the related results in Table IV. 

Gtade Twelve \^ " 

Table VI presents the data for Grade 12 for the students' knowledge of 
occupational characteristics, their knowledge* of occupational preparation 
requirement 8 J a general sumiaary of e:cploratory occupational experiences, 
' their career planning knowledge and their career planning involvei.ient . 
The data are presented in terms of the significant statistical differences 
of the neans of the control and treatnent groups ♦ 

TABLE VI 

SUIIIARY OF TEST RESULTS FOR OCCUPATIOJAL CKARACTERISTICS, OCCUPATIOiCftL 
PREPARATIOII REQblREIirriTS, A GZilERAL SUILIARY OF EICPLOR/vTORY OCCUPATIONAL 
EXPERIEJCES, CAREER PLAiTillNG KUO^JLEDGE AIH) CAREER PLAxnilllG IIWOLVEiIEirr 

FOR GRADES 12 . 



Variable 


Sample Ueans 
For Control Group 


Sariple Means 
For Treatment Group 


t -Value 
2 dfs 


Significance 
Level 


Occupational 
Character islfcs . 


/fl.22 


. A2.19 


.76041 


A* 


Occupational 
Preparat ion 
Requireiiients 


12.66 


, 12.66 


0 


A 


General Sumnary 
of Exploratory 
Occupational 
Experiences ^ 


1.C4 


1.78 


-2.3534 


.14 


Careey Planning; 
Knowledge 


28.11 


29.96 


2.7389 


.12 


Career Planning 
Involvement 


1.91 


1.98 


1.1587 


A 



''<A - Significance level sweater than .15 
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Test Interpretation 

The treatment group did statistically significantly better in the 
/ 

general supiary of exploratory occupational experiences than did the 
control group. Likewise they scored better concerning their career planning 
knowledge • 

Observation • ^ 

Despite ^he statistically significant difference in favor of the treat- 
ment group the Project staff as w^l as the school staffs need to continue 
their efforts tb assist students in these two areas as well as the others. 

Table VII presents the data relative to exploratory occupational 
experiences related to occupational clusters, T^e data are presented in : 
terms of the significant Statistical differences of the means of the control 
and treatment groups for grade 12. . 

TABLE VIX 

SUIEIARt OF TEST RESULTS RELATING TO EXPLORATORY OCCUPATIONAL EXPERIEI^CES 
RELATED TO OCCUPATIONAL CLUSTERS FOR GRADES 12 - ^ 



Variables 


Sacple Means For 
Control Group 


Sample ! leans For ; 
Treatment Group 


t-Value 
2 df's 

i - -i- 


Significance 
Level 


Social, Health & 
Personal Services 


1.75 


1.75 


0 


A* 

1 




Business Sales h 
^ llanagement 


1.86 


1.79 
f , 


-2.4752 


1 

.12 / 


Business Operations 


1.82 


1.75 


-.92519 


A 


Technology & Trade 


2.03 


i.«9 


'.-.78446 


A 


Natural, Social ^ 
& lledical Sciences 


1.70 ^ 


1.66 


-.51210 


''A 


Creative h Ap^iSLed 
Arts 


1.73 


1.71 ' 


-.84889 





*A - Significance level greater than .15 



45 



53 



Test Interpretation 

The treatment group scored statistically significantly , better than 
the control group in the area of business, sales and management. 
Observat ion 

Although the treatment group did better than the control Relative to 

business, sales and management, the Project staff and the school^staf f s 

need to continue their efforts to assist students in this area as well aa.. , 

I **** 

the others. 

Some of the Interpretations and observations made by Dr. Billie T. Rader 
relative to the results of his tests at the third and sixth grade levels 
no doubt are applicable at the sixth and twelfth grade ^levels as wall. * 

A great deal of caution must be exercised in the interpretation of 
the results of thfe three tests used. It must be recalled that evaluation 
by means of standardized tests was not anticipated by the Project staff 
nor the participating school staffs. Furthermore, the idea of evalu^ition by 

r 

tests vfas introduced almost 18 months after the start of the Project. 

In view of these circumstances these schools do not represent sampling in 

the true sense. The schools represent oniy themselves^ 

In addition, there are the usual cautions to, be observed relating to 
the "use of treatment and control groups as well as the use of pre and post 
test situations^ There are also the possibilities of contamination and the 
Hawthorne effect, l^ever-the-less, keeping these qualifiers in mind, the 
results do provide food for thoucht and some guide posts as the Project 
personnel anticipate a productive last year working with the respective 
schools. 
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The availability of standard tests in the field' of Career Education 

provide schools with the ready means, to establish objectives and anticipated 

J 

outcomes as well as a means for evaluating instructional activities in Career 
Education* This is not to say that these tests cannot be developed locally, 
in fact, local development should be encouraged. However, for many school 
systems, the conmercially produced t;^est will facilitate thfe evaluation of 
career educational instructional activities. . The tests used in this 
evalua^pn bear the 1974 copyright date. - Thus, unlike in previous years, 
in many instances the fevaluation of programs in Career Education may be 
measured more objectively. Measurements of this kind require that speodfic 
goals and anticipated outcomes be established. 
Re commenda t ion s 

li The test'results of the present -evaluation should be studied by 
the various participating schools under the leadership of the 
Project staff. 

2. Objectives and anticipated outcomes -'should be established by the 
participating schools. 

3. These objectives and anticipated outcomes should be written 
I and the methods of implementation and the use of instructional , 
1 materials should be anticipated in the witten statement. 

\ 4. The ^progress in each school toward the achievement of these 

I \ goals and outcomes should be measured, emong other ways, 

• j by means of a pre and post test. 
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[]J1J1^«;^ -.V^ UNIVERSITY OF V/lSC«NS!ti~EXTENSION ^ 

tO^tLL HALL 610 LAN'GOON STREET WADiSON. WISCONSIN 5370e» TLLEMMC^^E^Ci! 3122 (AHLA CC>DE OOaj 
WISCONSIN SURVEY RESEARCH LABORATORY ' July 8, 1975 



M E M'O R A K D U 




TO 
FROM 
RE 



JPr^fesSor Ahrnsbrak 
Charles Palit 
Analysis of School Data 



r 



The design of the experiment apparently involved the selection 



On^he assumption that sTchooIs were randomly assign^ to the treatment 
and control groups, a model of the test-scores for iiidiVidual students * 
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for a specific class level is: 




where 



y(J^^ is an overall n:ean level of performance 

^ is the effect of the treatment 
, Oc'^; is the effect of the stuc^nt being in the 
^/ is a random component peculiar to the stu 
^{ ^ is taken to have 
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schc^..j and 



->a zero mean and some variance IT" . We can express tRe mean performance 
of students in a school for a specific grade by 



where /) ^; is the number of students in the school at the grade level of 
interest. We can also wite: 
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^ — Oif school is in 

JC^ JT the tr(?atn?Cint: gro'op 

' A- C K otherv7is<^ 

th th ^ ' 

If the j 'and k schools are in the control group, and If we can assume 
that tliey were selected random then 

/ : 

has iiKian zero; since ^-^ ^ ~ K raean zeroN^under the randomi J'.at ion 



assumption. On the assurption that ^ and are inde 

pendent the expected value of C^,j*^X..;<jis <^ ^ ^ ^ ' & 
^ ^ 's^ 



or 



C^s V. - ' I ^ 

^ The term ^ is likely to be small by co^.p^^rison with 
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since 7 
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where is the number of students in the j^^ school ac the grade level 

of interest. Consequently, if v:e assume that the "^^^ ^ are from a normal 

distribution with variance C7 then ^ -^is distributed 

approximately as a / ^ variable. The s^me argument holds for 

i 

the treatment group so that . ^^^^ ^ 



ia approximately distributed as a ^j^^ J^' ^ variable, where * / and ^ 

are from control group schools and >C. v and ' are from treatment 

group schools. 

It follows then that / — ^ ^ ^ ^ ^. • 



is approximately a t-distribution with two degrees of freedom. 
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SUWIARY AND ^RECOMMENDATIONS 

Anticipatioti of the consequences of the efforts expended during the -three 
year Project after two years pf, its existence is in order. The momentum 
developed ^and the direction set during the first two years will carry the 
Project to/i?s successful conclusion. Funds were used purposefully and 

\ ' ' ' 

judiciously. The local District boarH ^a^ well as those agencies whose pur- 
poses are of cooperative nature, in cases such as this, for the welfare of 
the citizens, can choose those aspects of the Project, whi^h thf^y^ rjnH r^-nHn'-ivr 
to the furtherance of their objectives. ^ ~ 



Exemplary projects ate chocc thot should Rot an ex^nnple or set a pattern. 

There are those aspect^of .feKe^roject which at the end of the first two years 

Indicate a pattern to be followed once the Federal funding ceases. For these 

aspects it is important that efforts be started to set up or set in motion ^ 

t^ie administrative machinery, describe positions to be filled, and duties to 

be performed by full time and part time personnel with the District Board of 

f 

Vocational, Technical and Adult Education, in other agencies, and .in coopera- . 
tion with other agencies. Other agencies to be directly /concerned are the 
.respective Cooperative Edacational Service Agencies. A^ncies with whom to 
coordinate the efforts of the District Board of ^^ocational, Technical and 
Adult Education are the social and welfare agencies of the respective 
counties along with the private agencies and local civic and professional 
^ organizations. Project personnel have worked with these^^encies with some 
success and -these relationships need^ to be fitmed up and formalized as much as 
possible. It is Important that no tl^e be permitted gto elapse for the under- 



.Standing and appreciation of the results of the Project to^become dissipated 
and for. the lack of leadership and funding* 
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A great deal of the effort of the Project personnel was devoted to the • 
slpn of the A 

{ 

:t periled, 



educa&lpn ot 

Project periled, ^ind understandably so* Newspapers, radio, TV, handouts, 
teachers meetings, panel discussions, film showings and ajjj^earances before 
professional and civic clubs were used to an advantage. Career Education is 
being introduced and Implemented in schools in various degrees and with 
varying success without legislative mandate as in co crc^t to other curricular 
offering. This may be a strength. What do the various publics conceive 
Career Education to be? To what extent do Llie various publics think that it 
applies to them? To what extent are they willing to finance it? These and 
related questions ought to be answered. Unless the answers to these questions 
and related ones are answered in favor of Career Education, the results of 
efforts at its Implementation may be a long time in coming. The financing 
of such an investigation would be in ordei^^^at this time. The results might 
" lead to a clarification of the present apj^roaches or other alternatives rather 
than a legislative mandat-ft And a more firm support for Career Education in 
our l^hools and fox adults out of school. 

The cooperation with and the coordination of efforts with other agencies 
has beSn mentioned above. Adults who definitely were in need of assistance 
from the Project often were not found in organized classes or groups, and if 
they were, they were in an agency not directly related to the schools. Often 
, * these adults had found the fulfillment of their primary needs with a welfar^ 
'^V.QP^cial agency supported by the 'government. More often these agencies were 
public rather than private, although not always. Personal characteristics of 
these individuals often were such that they were very wary, of highly organized 
groups^ at leaat at first, j^j^malizedtcooperative and coprdinated and, hope- 
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fully, integrated efforts should be instituted with public and private 
agencies for the benefit of these adults 16 years and over* 

The category of Adults 16 Years and Over is a very broad one and the 
category or the terminology in reference to it should be used with reseirva- 
tions. Often the term adult is used when the speaker has in mind a specific 
category of adults. There are too many categories of individuals under this 
general heading to talk about them meaningfully. At first the efforts to 
serve individuals or groups in this" broad category were too diffused, first, 
in an effort to reach them through the media, and later, in trying to work 
wlrti "TtrairliT ^groupsv~ Tn T^irey, efforts' ar coi^tactirtg these~ people- should - — 
be as specific publics and/or as individuals. After some experience. Project 
personnel did deal with them in groups. Furthermore, the efforts should be 
directed toward the disadvantaged. To be of assistance to well educated 
women in the cause of the equal status of women is noteworthy but the disad- 
vantaged are in far greater need of assistance. 

The efforts to evaluate personnel are hazardous. This becomes more so 
as the end product becomes farther removed from the source of the innovation. 
In the case of this Project there are at least the Project consultants and the 
teachor« between the originator of the Project and the recipients, students 
or adults. These hazards can be reduced first, by a very specific delineation 
of objectives of the Project,, a description of the activities and skills of 
the consultants for reaching the outcbraes, and then the outcomes anticipated, 
the outcomes to te stated as much as possible in as near behavioral terms 
as possible. Secondly, these hazards can be re-^ucel still more ±t before 
emplpyment of personnel a job analysis is made and a* job description is pre- 
pared. This job description should include a description of any specific 
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competencies or skills that nay be r^uired. These job specifications can 
be still further enhanced by a statement of job expectations. Job expecta- 
tions are those activities and results of efforts of the consultants which 
are over and above those normally required to carry on the work of the Project. 
Thirdly, a continual review of the activities and problems and successes 
encountered by the entire Project staff are essential* To insure this con- 

*^ stant review, the Director of the Project should formaJiiSe'T^^bhedule of such 
♦ *• 

review meetings as well as provide for special meetings requested by a member 
of the staff. Project personnel, after a few months of experience with their 
organizational structures and location of consultants out in their respective 
territories J revi5e<i the structure .and based aIL consultants in the cenCx^al 
office in order to improve communication and to use the special abilities of 
the consultants where t,he respective consultants saw the need for them. 

In summary, the ^efforts during the last year of the Federal funding should 
be directed in p^t, toward formalizing working Relationships with schools and 
Cooperative Educational Services Agencies, and welfare and social agencies, 
public and private, and civic and professional organizations. Secondly, ^the 
number of publics to be served by the Project should be reduced in order that 
specific gains or failure of gains may be -determined and in order to establish 
the success or failure of given methods used as a xoeans to achieving the goals 
of the Project. Specific types of persons or groups phould be identified 
with whom to work such as the schools and welfare mothers or certain categories 
of unemployed men and/or ^men. 

^ Recommendations 

1.. The administratio;i of^the NCTI shotxld establish a formal liaison t/lth 
-social— 8end.ce -agencies in^-order^ to workjnLth_adults. ^ 

agencies fill a primary-need^ It appears that whenever a primary need \ 

* * • 
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is fulfilled for an adult the Project staff achieved a degree of 
success which would not have been gained without the cooperation of 
the agency • 

1. The administration of the NCTI should aeek the cooperation of public ) 
school administrators to establish a position in the Cooperative Edu- 
cational Service Agencies represen£ed^in the District to assist the 
pu^^lic -schools (private if possible) with ^the implementation of Career 
Education. Persons filling these positions should be qualified to assist 
with implementation of the curriculum, the establishment of behavioral 




objectives and the evaluation of the program. ^ * 

3. The administration of the NCTI should make formal provisions for its 

instructional staff to articulate the vocational programs in the secondary 
schools with the voj::ational-techntcal programs at the NCTI and to be 
of assistance to the pei^sons in the Cooperative Educational S'ervice 
Agencies responsible for Career Educatipn in the public atxd private 
elementary and 'secondary schools. - 
i\. A special project should*be financed to conduct a survey that would: 

a. identify ^all the publics of a community relative to their concepts 
of Career Education^ 

b. identify the varidus publics in relation to those ;rfio might 
profit from Career Edi^^^ion, -arid 

c. determine the degree of suppor-t for the implementation of Career 
Education at. levels K-14 and for Adults- 16 years and Over, 

The results of such a ^p/ey should enable a school system^ontenplating 
the introduction of Career Education to deal with the several publics 
effectively; firsts as to who understands the concept, secondly, who is in 
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favor of the adoption of the concept and thereby gain, support for it, 
and thirdly, the identification of the prospective clientel for the ^ 
Career Education program and" the attitudes of this clientel toward ^it^ in 
order to enable the school staff to prepare effectively for dealing with 
this clientel. 

5. For the next year, limit the number of categories of Adults 16 and Over 
to be dfealt with. 

6. The Project consultants should fina up their coordinating and coop- 
erating efforts with the staff effprts of organizations who seem to 

COtmand rtie co n ti n u ed" at fenfc ton -of 1:he adults -elieivfeeOr th e y g erv6 The 

consultants have had some experience with this. 

7. The disadvantaged need to be sought out. For awhile they may need to 
be dealt vrilth on a one to one basis. Tne consultants need to use the 
case study approach and keep records as does a clinician in order to 
offer guidance and to observe and record progress. 

3. Consultants should concentrate on working with the Tuesday Morning 
Mothers Gronp . because they are a disadvantaged group. Again, consul- 
tants should use the case study approach to enable,^^them to be produc- 
tive as well as to measure progress. 
9. Consultants when working with groups should establish a specific goal or 
goals and decide the means by which theXachievene^nt. of these goals can 
be determined, llethods of evaluation shpuld.be determined in advance 
with the group.' This would insure not only effective presentation 
but would assure the group that its needs would be met. 
10. The professionals in all social and welfare agencies have similar 
* problems and^Jthey are similar to those of ^the Project consultmits. 
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Therefore, efforts should be continued to exchange knowledge and other 
resources with each other as well as to procure clientel. 

11. The art;Lculation of the efforts of the Project consultants with the 
instructional staff of the NCTI must continue. 

12. The use of tlie instructional resources of the NCTI for the development 
of materials of instruction for use in the elementary and secondary 
schools is to be commended. TJj^Nextent to vzhich this must continue is 
dependent on the responsibilities Career Educatioa accepted by the 
Cooperative Educational Service Agencies after the Project is terminated. 



13. After school administrators have' given their approval to the Project 
consult an tds^to^^^rk with instructional personnel. . consultants work 
with the teachers regularly. However, Project personnel have found 
out* that their success has been in those schools where they had the. 
continued support of the administration. The administration of the 
schools must continually be informed and a definite time and. procedure for 
doing so must be established. 

14. School administrators should be encouraged to release teachers from 

f 

classes and to employ substitute teachers to enable regular teachers to 
attend workshops, in-service training and to develop materi|ils of 
instruction. 

15. The induction and orientation of nex^ teachers to* Career Education should 
be encouraged. 

16* The appointment of committees of teachers system-wide to plan guides for 
Career Education for adoption by school administrations should be 
encouraged. Such teacheif participation in policy formation makes for 
continued success of Career Education. „ • 
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17. Ad hoc citizen participation whenever thBy can help develop ,and 
strengthen the program should be encouraged. 

18. ,That objectives, activities and outcomes established for the Project 
and for subsidiary (^pects of a project constitute an aspect of per- 
sonnel evaluation. 

a. Specific objectives for subsidiary coiaponents of a project along 
f with the general objectives should be stated. Obje^ives are 

guides to action and the greater the specificity, the more likely 
is the effort of the co.iSultant to be directly related to the objec- 
tives i 

b. Specific anticipated activities to be conducted by the consultants 
in their efforts to carry out the purposes of the Project should 
be stated. These may be modified, from tiiae to time as circum- 
stances may dictate. 

c. Specific outcomes anticipated by the consaltan^ resulting from 
their efforts to implement the objectives should be listed. 
Variation in outcomes can always be explained^ and many times 
justified. Outcomes may be demonstration of skills, verbal or 
physical, they may be interactions among persons and they may 
be written responses. 

* These^atements submitted prior to the signing of an evaluation 
agreenent will serve as a means to arriving at a consensus betv/een 
the project personnel and the evaluation team ct)nceming the method of 
evaluation. • * 

The benefit to be derived from such an understanding would enable: 
a. the consultants to pursue a more purposeful activity 

^ , 
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b. the consultants to direct their energies to specific targets 

C;. the evaluators to eliminate as much bias as possible since they ^ ^ ^ 

would be looking for specific pre and post data rather than relying 
on the possibility that they may understand the client's previous 
condition ^ 

Specific items furnished by the consultants to be evaluated would 

m 

be more likely to produce a more fair evaluation of the consultant's 
efforts. The evaluators should evaluate on the basis of stated antici- . 
pated outcomes and the effort put forth by the consultants rather than 

the evaluators' expected outcomes and the effort' the evaluators think 
the consultant should have put forth. The latter point of what the 
evaluators believe the consultants should have done in preference to what 
he did is a question that can be discussed aft^er the evaluation. 

19. That job analysis and job descriptions be instituted to enable consultants " 
to know what is considereji normal accomplishments. 

20. That expectations of job performance beyond the goals of normal accomplish- 
ment be established. 

21. That formalized procedures for constant communication be maintained and 
improved whenever possible. - ' ^^""^^^^.^/^^ 

22. The test results of the prese'nt evaluation should be studied by the various ^ 
participating schools under the leadership of the Project staff. ' . 

23. Objectives and anticipated outcomes should be established by t\ie participating 
schools. 

2A. These objectives and anticipated outcomes should be written and the methods 
of implementation and the use of instructional^ irfateria Is should be 
anticipated in the written statement. 

25. Thejprogress in each school toward the achievement of these goals and 

outcomes should be measured, among other ways, by ^means of a pre and post test- 
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CENTER FOR STUDIES IN VOCATIONAL AND TECHNICAL 
EDU^C^TION, UNIVERSITY OF WISCONSIN- MADISON 



The Center for StOdies in Vocational and Technical 
Education at the University of Wisconsin-Madiwnwas 
reorganized with the support of the Wisconsin Board 
of Vocational, Technical and Adult Education within 
the School of Education in 1971 . The function of the 
Center, is to serve the State of Wisconsin in a unique 
way by bringing the resources of the University to 
bear on identified problems in the delivery of voca- 
tional and manpower prog rams— vocational education, 
technical education, adulteducdtion, career educa- 
tion, manpower training— to citizens of all. ages in 
all communities of the State. The Center focuses 
upon the delivery of services includjng analyses of 
need,targetgroupsserved, institutional organization, 
instructional and curriculum methodology and content, 
labor market needs, manpower policy, and other ap- 
propriate factors i To the extent that these goals- are 
enhanced and the foci of problems widened to en- 
compass regional and national concerns, the Center 
engages in studies beyond the boundaries of the State. 



9> 



Merle Strong, Director 
Roger Lambert, Associate Director 
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